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Abstract 

We give a complexity dichotomy theorem for the counting Constraint Satisfaction Problem (^^CSP 
in short) with complex weights. To this end, we give three conditions for its tractability. Let T be any 
finite set of complex-valued functions, then we prove that #CSP(7^) is solvable in polynomial time if 
all three conditions are satisfied; and is #P-hard otherwise. 

Our complexity dichotomy generalizes a long scries of important results on counting problems: (a) 
the problem of counting graph homomorphisms is the special case when there is a single symmetric 
binary function in T |121 [51 116[ [7] ; (b) the problem of counting directed graph homomorphisms is the 
special case when there is a single not- necessarily-symmetric binary function in J- [10[ [6] ; and (c) the 
standard form of #CSP is when all functions in T take values in {0, 1} [Tl lT^fn] . 
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1 Introduction 



It is well known that if NP ^ P, there is an infinite hierarchy of complexity classes between them |18j . 
However, for some broad classes of problems, a complexity dichotomy exists: every problem in the class is 
either in polynomial time or NP-hard. Such results include Schaefer's theorem [20], the dichotomy of Hell 
and Nesetfil for iJ-coloring [T7], and some subclasses of the general constraint satisfaction problem (CSP 
in short) [9]. These developments lead to the following questions: How far can we push the envelope and 
show dichotomies for even broader classes of problems? Given a class of problems, what is the criterion 
that distinguishes the tractable problems from the intractable ones? The famous dichotomy conjecture 
by Feder and Vardi on decision CSP [15], which motivated much of the subsequent work, remains open 
to date. Now replacing NP with ^^P [23], both questions above can be asked for counting problems and 
in particular, the counting constraint satisfaction problem (#CSP in short). 

In this paper, we study the complexity of ^CSP in its most general form with complex weights. Let 
D = {1, . . . ,d} he a finite set, called a domain. A weighted constraint language J- over the domain D is 
a finite set of complex- valued functions {fi, ■ ■ ■ , fh}, where fi : D^^ — )• C for some rj > 1. The language 
then defines the following counting constraint satisfaction problem, denoted by #CSP(J-'). The input 
consists of a tuple x = (xi, . . . , Xn) of variables over D and a collection / of tuples (/, ii, . . . , v) in which 
/ is an r-ary function from and ii, . . . ,ir € [n]. It defines the following function Fj over x € -D": 

Fli^) = n fi^il^-'-^Xir)- 

if,h,...,ir)ei 

And the output of the problem is the following sum: Z{I) = X^xG-D" ^li^)- 
Various subclasses of t^CSP have been studied intensively recently: 

Counting graph homomorphisms: This is the special case when the language J- has a single 
symmetric binary function. A series of dichotomies have been discovered for functions with {0, 1} 
weights by Dyer and Greenhill [12], nonnegative weights by Bulatov and Grohe [5], real weights by 
Goldberg, Grohe, Jerrum and Thurley [16], and complex weights by Cai, Chen and Lu [7]. 

Counting directed graph homomorphisms: This is the special case when has a single not- 
necessarily-symmetric binary function. In [11], Dyer, Goldberg and Paterson show a dichotomy for 
{0, 1} functions that induce an acyclic graph when viewed as the adjacency matrix of a directed 
graph. Then Cai and Chen [6] give a dichotomy for all nonnegative binary functions. 

The standard form of ^^CSP: This is the special case when every function in T takes values in 
{0, 1}. Bulatov makes a breakthrough and proves a complexity dichotomy for this class (which we 
will refer to as unweighted if^CSP). Later Dyer and Richerby give a simplified proof of his theorem 
and also prove the decidability of the dichotomy criterion in [131 [T3] . It is then extended to include 
nonnegative and rational weights by Bulatov, Dyer, Goldberg, Jalsenius, Jerrum and Richerby [1], 
and nonnegative weights by Cai, Chen and Lu [5]. 

In this paper, we generalize all these results and prove a dichotomy for ^CSP with complex weights: 

Theorem 1 (main). Given any constraint language T with algebraic complex weights, #CSP(J-') is either 
in polynomial time or #P-hard. 
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To prove the dichotomy, we introduce three conditions on the language T: the Block Orthogonality 
condition, the Mal'tsev condition and the Type Partition condition. We show that ^CSP{J-) is ^^P-hard 
if violates any of these three conditions; and give a polynomial-time algorithm that solves #CSP{J-) 
when J- satisfies all three conditions. 

Proof Sketch 

The proof starts with the following framework for solving ^CSP(J-"). Let / be an instance of 7^CSP(J-") 
and F be the n-ary function it defines. We let F^'^\ for each t € [n], denote the following t-ary function: 

. . . ,Xf) = ^ F{xi, . . . ,xt,xt+i, . . . ,Xn). 

In the discussion below, it is more convenient to consider i^W as a d*^^ x d matrix when t >2: the rows 
are indexed by x = (xi, . . . ,xt-i); the columns are indexed by i € -D; and the (x, i)*'^ entry is F^^\x,i). 
In particular, we use ^[^^(x, *) to denote the d-dimensional row vector indexed by x S D^~^. 

In an ideal world, Z{I) can be computed efficiently with the following oracle: We can send any tuple 
X € D^"^ to the oracle, and it returns a d-dimensional vector v that is linearly dependent with FM(x, *). 
Here either v = if FW(x, *) = 0; or v has its first non-zero entry normalized to 1 so that it is unique. 

With the help of such a powerful oracle, we can compute Z{I) as follows. From Z{I) = X^^g^) F^^^a) 
it suffices to compute F^^\a) for each a ^ D. Pick any ai G D, and we send it to the oracle. The oracle 
returns a vector v that is linearly dependent with FP](ai, *). If v = then F^^\ai) = XlbeD -^'^^^Ij ^) = 
0. Otherwise, let 02 G -D be the index of the first non-zero entry of v, with = 1- Then we have 

where the last equation follows from the assumption that F^'^^ai, *) and v are linearly dependent. This 
reduces the computation of F^^\ai) to F^^\ai, 02). Next we send (ai, 02) to the oracle. Either the vector 
w we get back from the oracle is 0, in which case F[2l(ai,a2) = 0; or we can use w to further reduce the 
computation of F^^\ai) to F^^\ai, a2, 03) for some appropriate 03 G D. Repeating this process for n — 1 
rounds, then it suffices to compute F^'^\ai,a2, • • • , a^) for some appropriate 02, . . . , a„ € D. This gives 
an efficient algorithm for computing F^^\ai) because F = F^""! can be evaluated efficiently using /. 

As a result, we can solve ^CSP{F) efficiently with such an oracle. It turns out that almost the whole 
proof of Theorem [1] is trying to understand how and when we can efficiently implement this oracle. Note 
that we essentially need to "collect" the following huge amount of information: For each i G [n], we need 
to compute a set of pairwise linearly independent (and normalized) fi-dimensional vectors v^*'^], . . . , v^*'**! 
for some sj > 0, so that every nonzero row vector i<'W(x, *) is linearly dependent with one of them. Also 
for each vector v^*'-'], we need to know the set of x G D^~^, denoted by S^'^'^^ C D^~^, such that i^W(x, *) 
is non-zero and linearly dependent with v^*'-^]. Two difficulties arise. First, note that in general an m x d 
matrix may have as many as m pairwise linearly independent row vectors. Thus in general, we may need 
to keep track of exponentially many vl'-^'l's. Second, for each v^*'-'!, S''*'-'! is in general exponential in t. 

To overcome the first difficulty, we drew inspiration from the recent dichotomy theorems for counting 
graph homomorphisms with real [16] and complex weights [7]. In both dichotomies those tractable cases 
are closely related to matrices in which every two row vectors are either linearly dependent or orthogonal 
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e.g., the Hadamard matrices and the so-called discrete unitary matrices [7]. This inspires us to introduce 
the first necessary condition for tractability: the Block Orthogonality condition. It requires that for any 
F defined by an instance of ^CSP(J^) and for any i G [re], every two row vectors of i^t*' are either linearly 
dependent or orthogonal; Otherwise #CSP(J-') is #P-hard. Actually a more stringent requirement than 
orthogonality must hold (as the word "block" suggests); Otherwise ^CSP{T) is #P-hard. See the formal 
definition in Section 13.11 Assume T satisfies the Block Orthogonality condition. Then we know for sure 
that each F'*] has at most d pairwise linearly independent (and indeed pairwise orthogonal) row vectors. 

To overcome the second difficulty, we need some of the powerful techniques developed for the unwei- 
ghted #CSP [H [13]. One of the tools used there is the notion of Mal'tsev polymorphism from universal 
algebra (see Section [2. 8p . In jl3j Dyer and Richerby introduce a succinct representation, called a witness 
function, for any set ^ Q Z?" that has a Mal'tsev polymorphism (p. A witness function of a set ^ C 
is of linear size in re, the arity of <I>, and essentially contains all the information about <I>. In particular, 
with a witness function one can decide whether a given tuple x G D"' belongs to $ efficiently. From here 
it is only natural to ask whether the sets S'^*'-^! associated with each v^*'-^] have a Mal'tsev polymorphism. 
This is where we introduce the second necessary condition: the Mal'tsev condition. Roughly speaking, it 
requires all the sets S't*'-'] C defined from all F,t and j, to share a common Mal'tsev polymorphism 

(p; Otherwise the problem ^CSP{J^) is ^^P-hard. 

We can now refine the plan of implementing the oracle as follows. Assume the language satisfies 
both the Block Orthogonality condition and the Mal'tsev condition. Then given any input instance / of 
^CSP(J-') which defines an n-ary function F, we compute for each t : 2 < t < n, 

(a) A set of (at most d) pairwise orthogonal and normalized d-dimensional vectors v'*'^!, . . . , v'*'***!, 
for some St > 0, such that every nonzero fW(x, *) is linearly dependent with one of them. 

(b) A witness function cjl*'-'] for each set S^'^'^\ which can be used to decide membership efficiently. 

So the only algorithmic problem left is, how (and when) can we compute these objects efficiently? 

To this end, we start with t = n and F = F^"!. First, by using the Mal'tsev condition and a beautiful 
algorithm of Dyer and Richerby [13] , we can construct efficiently a witness function uj for R C where 
X G -R if and only if -F(x) ^ 0. With uj, it is also easy to construct a witness function uj' for R' C D^~^, 
the projection of R on its first re — 1 coordinates. We are getting closer because by the definition of S''"'-'', 
R' is exactly the union of the s„ pairwise disjoint sets S"'"'^', . . . , S"!"'*"] C D^~^ . Skipping some technical 
details, what we need boils down to the following splitting operation over witness functions: 

Let $ C be a nonempty set, and let ^'i, . . . , ^'s be an s-way partition of for some s G [d\: 
The ^j's are nonempty, pairwise disjoint, and satisfy $ = ^'i U • • • U ^ s- Assume that 99 is a 
Mal'tsev polymorphism of <I> and all the ^iS. At the beginning, we have completely no 
information about the ^'i's, not even the number s of the ^j's, though we do know that s G \d\. 
The only resources we have are a witness function uj for $ and a black box to query: We can send 
any x G <!> to the black box and it returns the unique index k G [s] such that x G ^k- The 
question is: Can we use uj and the black box to compute s G [d\ as well as a witness function ujk 
for each in polynomial time and only using polynomially many queries? 

In general, we do not know how to implement the splitting operation above efficiently. However, if $ 
and ^1, . . . , satisfy the so-called partition condition (see the definition in Section [3T|) then we present 
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an algorithm that computes s € [d] as well as a witness function Wfc for each in polynomial time and 
using polynomially many queries. This finally brings us to the last condition: the Type Partition condi- 
tion. It turns out that this condition is also necessary for tractability. If violates it, then ^CSP{J-) is 
T^P-hard. Roughly speaking, the Type Partition condition requires that whenever we need to apply the 
splitting operation, $ and ^'i, . . . , ^'^ satisfy the partition condition so that our algorithm works. In par- 
ticular, it requires R' and S^"'''^\ . . . , Sl"'^"! to satisfy the partition condition and thus, we can apply the 
splitting operation to construct a witness function for each Sl"'-?] using lo' . The proof showing that the 
Type Partition condition is necessary (Section [5]) and the algorithm for the splitting operation assuming 
the partition condition (Section 17. 3p are among the most challenging in the paper. Moreover, with the 
help of the splitting operation and the Type Partition condition, we can inductively construct a witness 
function for each S''*'-'' from t = n to 2. Therefore, we get an efficient implementation of the oracle and 
thus, the problem ^CSP(J-') is in polynomial time when all three necessary conditions are satisfied. This 
finishes the proof of Theorem [TJ 

2 Preliminaries 
2.1 Notation 

For convenience, we let C denote the set of algebraic complex numbers throughout the paper and usually 
refer to them simply as complex numbers when it is clear from the context. 

Let D = {1,2, . . . , d} he a finite set, called a domain. Let F : — )> C be an n-ary complex function. 
We use lm(F) to denote the image of F, i.e., 

lm(F) = {c G C : c = F(x) for some x G Z)"}. 

Given a finite set T = {Fi, . . . ,Ffi} of functions, we use Im(J^) to denote the image of J-: 

\m{T) = lm(Fi)U---Ulm(F/j). 

Given F : — t- C, we use F^^\ for each i G [n], to denote the following t-ary function: 

, Xi, Xi-\-\ 1 ■ ■ ■ 1 Xn) ■ 

Note that fI"' = F. We also use to denote the non- negative function defined as follows: 

|F| : x |F(x)|, foraUxGL*". 

Given F = {Fi, . . . ,Fh}, we use to denote . . . , 

Given F : C where n > 2, in certain situations we consider F as a matrix with exponentially 

many rows but only d columns. We let Mp denote the following d""^ x d matrix: The rows of Mi;' are 
indexed by x = (xi, . . . , x„„i) G D^~^; the columns are indexed by x„ G D\ and the (x, x^)*^ entry 

MF{yi,Xn) = F{yL,Xn) = F{xi, . . .,Xn-l,Xn)- 
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For any x G D^~^, we use i^(x, *) to denote the d-dimensional vector whose i**^ entry is -F(x, i). We use 
|F(x, *)| to denote the d-dimensional non-negative vector whose i"^ entry is |-F(x, i)|. 

Given an m x n matrix M, we use M(z, *) to denote the row vector of M. 

Given two vectors x and y € C^, we say they are orthogonal if 

Given x € and ^ G [n], we use Pr[^]X to denote its prefix of length i. 

Let $ C L)" be an n-ary relation. For each £ G [n], we let Pr^<& C D denote the projection of $ on the 
t'^ coordinate: a G Pr^^ if and only if there is an x G <1> such that = a. We call x a witness for a at the 

coordinate, or simply a witness for the pair {I, a). We also use Pr[£]$ Q to denote the projection 
of $ on the first ^ coordinates: y G Pr[^]$ if and only if there exists an x G <1> such that y = Pr[£]X. 

Given a vector a G for some £ G [n], we let $(a, *) = $(ai, . . . , a^, *) denote the relation on n — ^ 
variables with the first H. variables fixed to a: y G <I>(a, *) if and only if a o y G 

Given a permutation vr over [n], we let denote the n-ary relation such that x G if and only if 

(x^(i),...,a;^(„)) G 

Finally we use <r to denote polynomial-time Turing reductions between problems, and =7 to denote 
equivalence under polynomial-time Turing reductions. 

2.2 Counting CSP with Algebraic Weights 

Let D = [d\ be a domain, and J- = {Fi, . . . ,Fh} be a finite set of complex functions over D. They define 
the following problem denoted by 7^CSP(J-"). An input instance of the problem consists of a finite set of 
variables xi, . . . ,Xn over D and a finite multiset I of tuples {F, ii, . . . , in which F is an r-ary function 
in J-" and ii, . . . , v G [n]- It defines the following n-ary function Fj over x = (xi, . . . , Xn) G D"^: 

Fi{^)= Yl F(x,,,...,XiJ. 

{F,il,...,ir)£l 

The output of the problem is then the following exponential sum: 

Z{Fj) = F,(x). 

When F = {F} has only one function, we also use ^CSP{F) to denote i^CSP{F) for convenience. 

To complete the definition of #CSP{F), we need to specify the model of algebraic number computa- 
tion, i.e., how the numbers in F and the output Z{Fj) are encoded. We can take any reasonable model, 
e.g., the one used earlier in [22l [211 IS]- This issue of computation model does not seem central to this 
paper because when the complexity of ^CSP(J-') is concerned, F is fixed and considered as a constant. 
The input size only depends on n, the number of variables, and |/|, the number of tuples in /. 

Given D and F, we can also define the following problem, denoted COUNT(J^): The input is a pair 
(I, c), where / is an input instance of ^CSP{F) and c is 3Xi algebraic complex number. Let xi, • • • , be 
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the variables over D in /, then the output is the number of x = {xi, . . . , x„) S such that 

Fj{x.) = c, where Fj is the n-ary function defined by /. 

It turns out that COUNT(J-') and #CSP(J-') are equivalent under polynomial-time Turing reductions: 
Lemma 1. COUNT(J-) =j #CSP(jr). 

Proof. Let Im(J^) = {ci, . . . , c^} where k = |lm(J-')| is considered as a constant because J- is fixed. Let I 
be an input instance of ^CSP{F) over n variables x G -D"" with m = \I\, and let F be the n-ary function 
that I defines. First of all, we can compute the following set of numbers in time polynomial in m: 

Cm = 1^1^ ■ ■ ■ c^* : ^1, • • • , ^fc are non-negative integers and ii + ■ ■ ■ + = , 

since A; is a constant. It then follows from the definition of F that F{x) S Cm for all x G D"". 
For each c G Cm, we let Nc denote the number of x G such that F{x.) = c, then we have 

ZiF)= F(x)= ^ c-iV,. 

xGD" cGC™, 

This immediately gives us a polynomial-time reduction from ^CSP{F) to COUNT(J-'). 

We prove the other direction: Given any /, we use a subroutine for ^CSP{F) to compute Nc for all 
c G Cm- For this purpose, we let C^ = Cm — {0} and let s = |C^| which is polynomial in m. We build 
from / the following instances /i, . . . , I^: to get I^, £ G [s], we make £ copies of each tuple in / and thus, 
Ii = I and |/^| = i ■ \I\. We also let F^ denote the n-ary function defined by 7^. 

By the construction of , it is easy to see that i*)(x) = (F(x))^ for all x G -D" and thus, 

Z{Fi) = F£(x) = Y ■ Nc= Y ■ Nc, for each i = l,...,s. 
xgD" ceCm cec^^ 

The left hand side of the equations can be obtained by calling a subroutine for #CSP(J-') on l£. We can 
then solve the Vandermonde system above to get Nc for each c G C'„^. If G Cm, we can also derive A'^o 
using the fact that the sum of all the Nc's, c G Cm, is (i". This finishes the proof of the lemma. □ 

In certain situations the problem COUNT(J^) is easier to use than ^CSP(J-'). For example, we use it 
to prove the following lemma. 

Lemma 2. #CSP(|7'|) <t #CSP(7'). 

Proof. By LemmalU it suffices to show COUNT(| J"]) <r COUNT(J"). We let lm(7') = {ci, . . . , Cfe} where 
k is considered as a constant because the set F of functions is fixed. 

Let / be an input instance of #CSP(|J-"|), and F be the n-ary non-negative function it defines. Let a 
be a non-negative number, and we need to compute the number of x G such that F{x.) = a. 

Prom I, it is natural to construct an input instance /' of i^CSP{F) by simply replacing the function 
\Fi\ in each tuple of / with its corresponding function Fi in F. Let F' denote the function that /' defines 
then it is clear that F(x) = |F'(x)| for all x G -D". 
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Let m = \I\ = I /'I, then we can compute 

Cm = I • • • c^*" ■ ^1, ■ ■ ■ are non- negative integers and ii + ■ ■ ■ + = m 

in time polynomial in m because /c is a constant. 

From the definitions of Cm and F', we have F'{x) E Cm. for all x € D^. As a result, 

the number of x such that -F(x) = a 

c&C,n- |c|=a 

and the right hand side can be computed efficiently, because the number of such c can be no more than 
\Cm\ and the term for each c can be evaluated by calling a subroutine for COUNT(J'). 

This finishes the proof of the lemma. □ 

2.3 Row Representation 

Let M be an m X n complex matrix. It induces the following equivalence relation '^m over 

|£ G [m] : M{e,*) / o}, 

i.e., the set of nonzero rows of M: 

i ~M *^=^ *) and M(/, *) are linearly dependent over C. 

We say that S = {(S*!, vi), . . . , (5^, Vfc)}, for some integer /c > 0, is the row representation of M if 

1 . 5*1 , . . . , 5fc ^ [m] are the equivalence classes of the equivalence relation ~m ; and 

2. For each i G [A;], Vj is a nonzero n-dimensional vector with its first nonzero entry being 1, and is 
linearly dependent with M(£, *), for all i G Si. (By the definition of ~M) Vj exists and is unique.) 

We will refer to as the representative row vector for the equivalence class Si. 

From the definition, it is easy to see that Si is nonempty for all i; the Sj's are pairwise disjoint; 

SiU---USk = [ie[m]: M{£, *) / o}; 

for all i ^ j, Vj and vj are linearly independent. Clearly every matrix has a unique row representation. 

In general, the row representation 5 of an m x n matrix M may consist of as many as m pairs. But 
if it is known that every two rows of M are either linearly dependent or orthogonal, then the number of 
pairs in its row representation cannot exceed n. 

For a non- negative M, we say it is block-rank-1 if its row representation S = {(S*!, vi), . . . , (S'fc, Vfc)| 
has the property that for all i ^ j [k], the two vectors Vj and vj have distinct positive entries. 

We next extend the notion of row representations to functions. Given any F : — ?• C with n > 2, 
we define the following equivalence relation over |x G D^~^ : F(x, *) 7^ O}: 

X ~F y *^=^ -^(x, *) and F{y, *) are linearly dependent over C. 
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the number of x such that F\x) = c 
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Similarly, we say 

S = {(Si,vi),...,(5fe,vfc)}, where Si C D""! for all i G [k], 

is the row representation of -F if 5 is the row representation of the x d matrix Mp. (Equivalently, 
we have Si, . . . ,Sk are the equivalence classes of and for each i e [/c], Vj is a non-zero d-dimensional 
vector with its first non-zero entry being 1, and is linearly dependent with F{x, *), x G Si.) 

Finally, we also call F a block-rank-1 function, if M|p| is a block-rank-1 matrix. (Equivalently, for all 
x,y G with -F(x, *) and F{y, *) being nonzero, the two non-negative vectors |-F(x, *)| and \F{y, *)| 

either are linearly dependent or share no common positive entry.) 



2.4 The Block-Rank-1 Condition 

We need the following dichotomy from Bulatov and Grohe [S]. Let A denote a symmetric d x d non- ne- 
gative matrix with algebraic entries. It defines the following graph homomorphism problem, denoted by 
EVAL(A): The input is an undirected graph G = {V,E) with V = [n], and the output is 

za{g)= yi (n^(^-^j-^ 

xi,...,x„e[d] \ijeE 

In the language of #CSP, EVAL(A) is the same as #CSP(F) with F{i,j) = A{i,j) for all i,j G [d]. 

Theorem 2. Let A be a symmetric and non-negative square matrix with algebraic entries, then EVAL(A) 
is in polynomial time if A is block-rank-1; and is #P-hard otherwise. 

We can also extend the definitions of EVAL(A) and ^a(") to any square matrix A over C. The input 
of EVAL(A) is now a directed graph G = {V,E), and the output is 

za{g)= y (n^(^-^i))- 

xi,...,x„e[d] \ij^E j 

The following lemma will be useful later in the proof: 

Lemma 3. Let A be a square {though not necessarily symmetric) matrix with algebraic complex entries. 
If \A\ is not block-rank-1, then EVAL(A) is ^F-hard. 

Proof. By Lemma[2l it suffices to show that EVAL(|A|) is ^^P-hard. To this end we use B to denote the 
symmetric and non-negative d x d matrix |A| |A|"^, where the {i,j)^^ entry of B is 

B{i,j)=Y,\Mhk)\-\Aij,k)\. 

k&[d] 

From the definition of B, we claim EVAL(B) <7 EVAL(|A|). This is because given any undirected graph 
G = {y,E) of EVAL(B), we can construct a new directed graph G' = {V',E') with 
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' = ^x^,X(. : u G y and e G E^ and E' = ^Xuxi, Xyxl : e = uv € E^. 
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It is then easy to check that Zb(G) = Z|y^|(G') from which the reduction fohows. On the other hand, by 
Cauchy-Schwarz, if |A| is not block-rank-1, neither is B. Then it follows from Theorem [2] that EVAL(B) 
is ^P-hard, and so is EVAL(|A|). This finishes the proof. □ 

Next, we use Theorem [2] to give a useful ^T^P-hardness lemma for ^CSP with a single complex- valued 
function. The idea is similar to the proof of Lemma [3] above. Let D = [d\ be a domain, then 

Lemma 4 (The Block-Rank-1 Condition). Let F : — )• C &e any algebraic complex function with arity 
r > 2. If F is not a block-rank-1 function, then ^CSP{F) is #P-hard. 

Proof. First of all, by Lemma [2] it suffices to show that #CSP(|-F|) is ^^P-hard. 

To finish the proof, we construct a symmetric and non- negative matrix A from \F\ such that 

EVAL(A)<r#CSP(|F|) (1) 

and then use Theorem O to show that EVAL(A) is ^^P-hard. 

To this end, we define the following matrix A: its rows and columns are indexed by x € D^^^, and 

A(x,y) = J]|F(x,i)| • \F{y,i)\. 

i&D 

It is clear that A is both symmetric and non-negative. 

Moreover, given any undirected graph G = {V^E) of EVAL(A), we construct the following instance / 
of #CSP(|F|): it has the following (r - l)\V\ + \E\ variables 

Xtj^i, . . . ,Xy^r-i,ye, for each v &V and e € E. 

For every e = uv (z E, we add the following two tuples to /: 

(^\E\j Xu,iy ■ ■ ■ T Xu^r—ij Ue^ and ^j-F"], . . . , • 

Prom the construction of / and the definition of A from \F\, it is easy to check that 

-^a(G') = Z{Fj), where Fj is the function that / defines. 

This gives us a polynomial-time reduction from EVAL(A) to ^CSP(|F|). 

Finally, we show that if F is not block-rank-1, then A is not a block-rank-1 matrix, and by Theorem 
[21 EVAL(A) is T^P-hard. Because F is not block-rank-1, we know there are two vectors x,y € D^~^ such 
that |-F(x, *)| and |-F(y, *)| share at least one common positive entry but are linearly independent. This 
implies that all the following four entries of A are positive: 

^(x,x), A(x,y) = A(y,x), A(y,x) > 0, 

but by Cauchy-Schwarz, we have 

A(x,y).^(y,x)= ('j]|F(x,i)|.|F(y,.)|] < [ J] |F(x, f) fe|F(y,i)|'') = A(x, x) • A(y, y). 

\ieD J \i&D / ViGD / 
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Therefore, A is not a block-rank-1 matrix by definition. This finishes the proof of the lemma. □ 
2.5 Block Orthogonality 

Let X, y € be two nonzero d-dimensional vectors. Let x' and y' be the two non-negative vectors such 
that x[ = \xi\ and y[ = \yi\ for all and assume that x' and y' are linearly dependent. As a result, these 
four vectors share the same nonzero entries, and we use T C [d] to denote the set of such indices. Let 

{/ii, . . . = {x- : i € r}, 

for some i > 1, such that fii > ■ ■ ■ > fii > 0. This further partitions T into Ti, . . . , with 

x[ = for all i and A; G 

It is also clear that y' would yield the same partition because it is linearly dependent with x'. 
Now we say x and y are Mock- orthogonal if for every A; € [I], 

^Xi-Yi = ^- (2) 

It is also easy to show that x and y are orthogonal if they are block-orthogonal: 

^Xi-Yi = ^Xi-Yi=^ ^ Xi • = 0. 

ie[d] i£T fcG[£] ieTfc 

We need the following property of two vectors being block-orthogonal: 

Lemma 5. //x and y are block- orthogonal, and the non-zero entries of these two vectors satisfy xf > 
and yf > for some integer K > 1, then we have 

Xi^^~^^ ■ yl^~^ = 0, for any integers s > and r > 1. 

Proof. We use the same notation as in the definition of block orthogonality above. For each i G T, we let 
Zi = Xi/\xi\ and Wi = yi/\yi\- Then by the assumption of the lemma, Zi and Wi are roots of unity whose 
order divides K. As x' and y' are linearly dependent, there are vi > ■ ■ ■ > vi > such that \yi\ = for 
all i and /c G Now we can rewrite ([2]) as 

Then the lemma follows from 



E /^f^^-.^^-^E--^ = o- 
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The second to the last equation uses the fact that Zi,Wi are roots of unity whose order divides K. □ 

We are now ready to define block-orthogonal functions: 

Definition 1 (Block-Orthogonal Function). Let F : D'^ C be a block-rank-1 function with n > 2. We 
call it a block-orthogonal function if for all x, y € D"^^ such that F{x, *), F{y, *) 7^ and x ^\f\ ihe 
two vectors Fix, *) and F{y, *) are either linearly dependent or block-orthogonal. 

2.6 Unweighted Counting CSP 

We need the following connection between weighted and unweighted 7^ CSP. The latter is the case when 
all the functions in J-" take values in {0, 1}, for which we adopt the following notation. Let D = [d] be a 
domain. An unweighted constraint language T over domain D is a finite set of relations {^i, ^2, ■ ■ ■ , ^h} 
in which every $j is an rj-ary relation over for some > 1. D and T define the following problem 
which we denote by ^CSP(r). Let x = (xi, . . . , Xn) € be a set of n variables over D. The input is a 
collection / of tuples (<^, ii, . . . , i^) in which <^ is an r-ary relation in F and ii, . . . ,ir € [n]. The input I 
then defines the following relation Rj over D": 

X G i?/ <;=^ for every tuple (<l>, ii, . . . ,ir) £ I, we have (xj^ , . . . , Xi^) € 

Given I, the output of the problem is the number of x € in this relation Rj. 

Given F : — ?> C, we use = Boolean (F) to denote the relation over n variables such that 

x£<^p F(x) / 0, for ah x € D". 

The following lemma is a corollary of Lemma [1} 
Lemma 6. Given a finite set of complex functions J- = {Fi, . . . ,Fh}, we have 

#CSP(F) <T #CSP(^), 

where F = {$1, . . . , and $i = Boolean(Fj) for all i G [h]. 

Proof By LemmalU it suffices to show that #CSP(F) <r COUNT(J'). 

Let / be an input instance of #CSP(F) over n variables and let R be the relation that it defines. We 
then construct an instance /' of 7^CSP(J-") in polynomial time, by replacing the relation <I>j in each tuple 
of I with its corresponding function Fi G J-, and let F denote the function that /' defines. Then we have 

X G F(x) / 0, for aU x G D", 

and thus, 

\R\=d'' - [the number of x G such that F(x) = O] . 
The right hand side can be obtained by calling a subroutine for COUNT(J^). □ 

2.7 The Purification Lemma 

As it will become clear later, it is easier to work with functions that take complex values with rational 
arguments. We need the following definition: 
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Definition 2 (Pure Functions). We call F : — )• C a pure complex function if F{x.) is the product of 
a non-negative integer and a root of unity, for all x S D". Given a pure function F, we use order (F) to 
denote the smallest positive integer K such that (-F(x))^ is positive for all x € with -F(x) 7^ 0. 

A useful tool in proving the hardness part of our dichotomy is the following Purification Lemma. It 
was introduced in the study of complex graph homomorphisms in [7], and gives us a connection between 
pure and general functions (which can take values with irrational arguments) . In Section U] and Section 
[5l we will see two examples where the Purification Lemma is used to extend two hardness lemmas from 
pure to general functions. 

Lemma 7 (The Purification Lemma). There is a mapping Pure which, given any finite tuple (Fi, . . . , F^) 
of complex-valued functions, produces a tuple of pure functions 

{Fi,...,Fi) = Pure{F,,...,Fh) (3) 

in which each F^ has the same arity rj > 1 as Fi, such that 

1. #CSP(F{,...,F^) =T#CSP(Fi,...,F;,); 

2. For every i G [h], we have Boolean(F/) = Boolean(Fj); 

3. For every i E [h] with ri > 2, if F- is block-rank-1 then Fi is block-rank-1 ; and 

4- If Fl is block-rank-1, then for any x, y G D^~^ such that Fl{x, *) and -F/(y, *) share 
at least one common nonzero entry, we have 

(a) F,-{x,*) and Fl{y,*) are linearly dependent iff Fi(x, *) and Fi{y,*) are linearly dependent; 

(b) If F-{x,*) and F'-{y,*) are block- orthogonal, then Fi{x,*) and Fi{y,*) are block- orthogonal. 

The proof of the Purification Lemma uses the following lemma from [?]• We start with a definition: 

Definition 3. Let C = {ci, C2, . . . , c^} be a set of nonzero algebraic numbers, for some n > 1. Then we 
say {gi, . . . ,gs}, for some s > 0, is a generating set of C if 

1. Every gi is a nonzero algebraic number in Q(C); 

2. For all (ki, . . . , ks) G — {O}, g^^ ■ ■ ■ g^" is not a root of unity; and 

3. For every c G C , there exists a unique tuple {ki, . . . , ks) G such that 

c 



^1 — 



is a root of unity. 



9i ■■■9s° 

Note that s = happens if and only if all the Ci 's in C are roots of unity. 

Lemma 8 (7.2 in [7]). Let C be a finite set of nonzero algebraic numbers, then it has a generating set. 
We now use Lemma [8] to prove the Purification Lemma: 
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Proof of the Purification Lemma. We first describe the mapping Pure, and then prove the properties. 

By Lemma [HI we use {gi, . . . ,gs} to denote a generating set of lm(Fi, . . . ,Fh) — {0}. Given a tuple 
k = (ki, . . . , kg) E Z^, we use g(k) to denote g^^ ■ ■ ■ g^" for convenience. By definition, there is a unique 
tuple k e for each c € lm(Fi, . . . , Fh) — {0} such that cj gi\i) is a root of unity. Because the functions 
Fi, . . . , Ffi are fixed, all the integers in k are considered as constants. 

We define F/ from Fi as follows. For every x G -F/(x) = if -Fi(x) = 0. If i<i(x) / 0, then there 
exists a unique tuple k € Z'' such that i^j(x)/g(k) is a root of unity, and we set 

where pi denotes the i^^ smallest prime. It is clear that Property 2 of the lemma is satisfied. In the rest 
of the proof, we will use p(k) to denote p'l^ ■ ■ ■ p^" for all k € Z'^. 

Next we prove the equivalence of the two problems. By Lemma [TJ it suffices to show that 

COUNT(Fi,...,F;,) =TCOUUJ{F{,...,Fi). (4) 

We start with the reduction from COUNT(Fi, ...,Fh) to COUNT(F{, . . . , F^). 

Given an instance / of #CSP(Fi, . . . , F^) over n variables, we use I' to denote the instance of ^^CSP 
{Fl, . . . ,FU obtained by replacing the Fi in each tuple of / with its corresponding function F-. Also let 
m = \I\ = \I'\ and let F and F' denote the functions that / and /' define, respectively. By Property 2, we 
have F{x) ^ iff F'(x) 7^ and thus, the number of x such that -F(x) = is the same as the number of 
X such that -F'(x) = 0. The latter can be obtained by calling a subroutine for COUNT(F{, . . . , Fj^). 

Let {ci, . . . , q} = lm(Fi, . . . ,Fh) — {0} with t being a constant since the set of functions is fixed. We 
then compute the following set Cm in time polynomial in m: 

Cm = ^c^i ■ ■ ■ '■ ■ ■ ■ , are non-negative integers and ii + ■ ■ ■ + it = rn^ . 

For each c € Cm we also compute the unique tuple k € such that c/g{]<.) is a root of unity, using the 
known tuples for {ci, . . . , q}. By the construction of F{, . . . , F^ from Fi, . . . ,Fh, and by the assumption 
that {gi, ... ,5s} is a generating set, we have 

F(x) = c F'(x) = p(k) • for aU x € F>". 

5(k) 

Hence, the number of x with F{x) = c can be obtained by calling a subroutine for COUNT(F^, . . . , F^). 
The other direction from COUNT(F{, . . . , Fj^) to COUNT(Fi, . . . , F^) can be proved similarly. 

Now we check Property 3. In the rest of the proof, we use F to denote Fi, F' to denote F/ and r to 
denote rj, the arity of Fj, for convenience. 

Assume r > 2 and F' is block-rank-1. Let x, y € D^~^ be two vectors such that F(x, *) and F(y, *) 
share at least one common nonzero entry. From Property 2 and the assumption that F' is block-rank-1 
we know that |F'(x, *)| and |F'(y, *)| must be nonzero and linearly dependent. 

To prove that |F(x, *)| and |F(y, *)| are linearly dependent, it suffices to show for all indices i,j £ D 
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of nonzero entries of F{x, *) (which are also indices of nonzero entries of F{y, *),F'{x, *), F'(y, *)), 

\F{x,i)\ • |F(y,j)| = \F{y,i)\ ■ \F{x,j)\. (5) 

To this end, we let u, v, w, z G denote the vectors such that 

F'{x,i) F'{y,j) F'{y,i) F'jxJ) 
p{u) ' p(v) ' p(w) ' p{z) 

are all roots of unity. Because |-F'(x, *)| and \F'{y, *)| are linearly dependent, we have 

pui+-i...pus+v. = \F'{x,i)\ ■ \F'{y,j)\ = \F'{y,i)\ ■ |F'(x,j)| = p^^+^^ ■ ■ ■ p^^+-^ 

and thus, Uk + Vk = Wk + Zk for all k G [s]. ([5]) then follows directly from the construction of F' . 

Next we prove Property 4(a). Assume that F{x, *) and F{y, *) are linearly dependent. Then we use 
i,j € D to denote two indices of nonzero entries of F'{x, *), which must be indices of nonzero entries of 
F'{y, *),F{x, *) and F{y, *) as well. Similarly, let u, v,w,z € be the vectors such that 

_ Fix,i) _ FjyJ) _ F{y,i) _ F{x,j) 

5(u) g(v) g{w) g{z) 

and ci, . . . , C4 are all roots of unity. Because -F(x, *) and F{y, *) are linearly dependent, we have 

C1-C2- g^^^' ■ ■ ■ g^^^''^ = F(x, i) ■ F{y, j) = F{y, i) ■ F(x, j) = cs ■ ■ g^^'' ■ ■ ■ gT^'^ . 

By the definition of generating sets, we must have ci • C2 = C3 • C4 and Uk + Vk = Wk + Zk for all /c € [s\. 
On the other hand, by the construction of F', we have 

F\x,i) ■ F'iyJ) = ci • C2-pr^^' ■ ■■pT^''^ = C3 • 04-^^+^^ • ■ ■ pf^^'^ = F'(y,i) • F'(x, j) 

and thus, F'{x, *) and F'{y, *) are also linearly dependent. The other direction can be proved similarly. 

For 4(b), assume that F'(x,*) and F'(y,*) are block-orthogonal. Note that when F' is block-rank-1 
F is also block-rank-1 by Property 3. We then use T C Z) to denote the set of indices j £ D such that 
F(x,j) (and F{y,j), F'{x,j), F'{y,j) 7^ as both functions are block-rank-1). We use F'(x, *) to 
further partition T into Ti, . . . ,Tt for some t > 1: there are positive integers ^1 > • • • > /xj > such that 

|F'(x,j)| = ^k, for all j G Tk and k G [t]. 

Since F' is block-rank-1, we know |-F'(x, *)|, \F'{y, *)\ are linearly dependent and thus, there are positive 
integers uji > ■ ■ ■ > ujt > such that {pi, . . . , fit) and (oji, . . . , cot) are linearly dependent and 

|-^'(y,i)| = Wfc, for all j G Tk and k G [t]. 

We also use c(x, j) and c(y,j) to denote the roots of unity such that 

F'{^,j) = Pk ■ c{x,j) and F'{y,j) = ojk ■ c{y,j). 
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Because -F'(x, *) and F'(y, *) are block-orthogonal, by definition, we have 

J]F'(x,i).F(^ = ^fc.o;fc^c(x,j).^(^ = 0, foraUfceM. (6) 

For each /c S [t], we use and € to denote the two unique vectors such that 

fj.k=p{uk) and uJk=p{vk). 

Then by the construction of F' from F, we have for all j ^T^, 

F{^,j) = g{uk) ■ c{^,j) and |F(x,i)| = \g{uk)\ (7) 
F{y,j)=g{vk)-c{y,j) and |F(y,j)| = |5f(vfc)|. 

Now we are ready to prove that F{x, *) and F{y, *) are block-orthogonal. Let v = \F{x,j)\ > for 
some j € T and let 5'„ C T be the set of indices j such that |F(x,j)| = v. Then by d?]) above S^, must 
be the union of some of the T^'s. Without loss of generality, let Sy = Ti U ■ ■ ■ L) Tq for some q < t, then 

^ F(x, j) • F{y,j) = ^ ^ 5(ufc)c(x, j) • 5(v/t)c(y, j) = ^ 5(ufc)s'(vfe) ^ c(x, j) • c(y, j) = 

where the first equation uses d?]) and the last equation uses This finishes the proof. □ 

We remark that in both Property 3 and Property 4(b) of the lemma, the statement only holds in one 
direction. For example, when Fi is block-rank-1, it is not clear how to prove that F^ is block-rank-1 as 
well. However, it turns out that the directions that we can prove are the ones that we will actually need 
later in proving those hardness lemmas for general functions. 

Using Property 2, 3 and 4 of the Purification Lemma, we have the following corollary: 

Corollary 1. Given ([3]), if F- is block- orthogonal, then so is Fi. Moreover, the equivalence relations 
and '^F'j defined by Fi and F-, are the same. 

2.8 Mal'tsev Polymorphisms and Witness Functions 

The algorithmic part of our dichotomy theorem uses the following concept of Mal'tsev polymorphisms: 
Definition 4. Let <1> C be an n-ary relation and ip : D"^ D be a map. If for any u, v, w G <I>, 

then we say <1> is closed under (p, and call a ternary polymorphism of ^. 

Given <I> C and (p : D, we use cl(^<I> to denote the closure of ^ under ip, that is, the smallest 

relation that contains ^ and is closed under ip. 

Definition 5 (Mal'tsev Polymorphism). Let <& C Z?" be an n-ary relation, then we say ip : -D^ D is a 
Mal'tsev polymorphism of ^ if ip is a polymorphism of ^ and satisfies 

ip{a, b, b) = ip{b, 6, a) = a, for all a,b £ D. (8) 
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Let r = {^"1, . . . , ^h} be a finite set of relations, then we say ip is a Mal'tsev polymorphism ofT if it 
is a Mal'tsev polymorphism of for all i € [/i]. 

Bulatov and Dalmau gave the foUowing ^P-hardness theorem. Also see Dyer and Richerby |13] . 

Theorem 3 ([2]). Let T = {^i, . . . ,<&h} be a finite set of relations. LfV does not have any Mal'tsev poly- 
morphism, then #CSP(r) is ^P-hard. 

Corollary 2. Let A. he a collection of [possibly infinitely many) relations. Either all relations in A share 
a common Mal'tsev polymorphism 93; or there is a finite subset P C A such that ^CSP(r) is #P-hard. 

Proof. Note that, given d, there are only finitely many maps ip : ^ D. We let P denote the set of ah 
such maps. Now assume the relations in A do not share a common Mal'tsev polymorphism, then for any 
(f P, there is a relation G A of which ip is not a Mal'tsev polymorphism. Then from Theorem [3l we 
know that #CSP(r) is #P-hard, where P = : ip £ P} is a finite subset of A. □ 

Let $ be an n-ary relation with variables xi, . . . ,Xn ranging over D, then in general |<I>j could be ex- 
ponentially large in n. But when ^ is known to have a Mal'tsev polymorphism and such a polymorphism 
(f is also given, Dyer and Richerby introduced in [13] the following succinct representation for <^>, which 
is similar to the "compact representation" of Bulatov and Dalmau [3]. We start with some notation. 

For each i G [n] we define the following relation ~j on Pr^ the projection of ^> on its coordinate: 
a ~j 6 if there exist tuples x € D^~^ and y^, y;, G such that 

X o a o y„ G $ and x o 6 o y^ G 

For the case when i = 1, we have a ~i 6 for all a, 6 G Pri<l> because they share the common empty prefix 
e. It was then shown in |13j that if $ has a Mal'tsev polymorphism, must be an equivalence relation: 

Lemma 9. //<& has a Mal'tsev polymorphism, then ^-^i is an equivalence relation for all i (z [n]. 

When $ has a Mal'tsev polymorphism, we let Si^k C Prj<&, where k = 1,2,..., denote the equivalence 
classes of ~i. Moreover, we can use the Mal'tsev polymorphism to show that 

Lemma 10. If a ^ib and x G <1> with Xi = a, then there is a y G <1> with yi = b and Pr[j_i]X = Pr[j_i]y. 
Proof. Because a ~i b, by definition, there exist z G D'~^ and ui, U2 G such that 

z o a o ui G $ and z o 6 o U2 G 

Applying a Mal'tsev polymorphism of <I> on these two vectors together with x G $ gives a new vector 
y G 'I'. It is easy to check that y satisfies both properties, and the lemma is proven. □ 

Next, we define the succinct representation called witness functions |13j . 

Definition 6 (Witness Function). Let C be a relation that has a Mal'tsev polymorphism, then we 
say u : [n] X D U {±} is a witness function of $ if 

1. For any i G [n] and a ^ Prj<l>, uj{i,a) = -L; 

2. For any i G [n] and a G Prj<l>, uj{i,a) £ ^ is a witness for {i,a), i.e., its ith component is a; 
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3. For any i G [n] and a,b £ Prj<5 with a ~i b, we have 

Pr[i_i]a;(i,a) = Pr[i^^uj{i,b). 

In [13] a subset of ^ that contains the image of a witness function of is called a frame of $. But in 
this paper, we will only use witness functions. The following lemma from [13] is the reason why a witness 
function is considered as a succinct (and linear-size) representation of ^: 

Lemma 11 (Membership). Let <1> Q be an n-ary relation which has a Mal'tsev polymorphism. With 
oj, a witness function of ^, and ip, a Mal'tsev polymorphism of ^, we can solve the following problem in 
time polynomial in n: Given x G , decide if x £ ^ or not. 

It is also easy to show that, if is a Mal'tsev polymorphism of $ C D", then all three operations on 
$ described in Section [2.11 that is, projection, pinning, and permutation, would result in a relation $' of 
which ip remains a Mal'tsev polymorphism. 

Lemma 12. Let ip be a Mal'tsev polymorphism of ^ CI D". Let i € [n], a G , and n be a permutation 
on [n]. Then <p is also a Mal'tsev polymorphism o/Pr[£]$, $(a, *), and ^j^. 

Moreover, given a witness function w of <I>, we can construct a witness function of Pf[i] ^, *) and 
$,r in time polynomial in n. For pinning and projection, the following two lemmas can be found in Dyer 
and Richerby [13]. In Section [3 we will discuss permutation and two other polynomial-time operations 
on witness functions, union and splitting. They will play an important role in the algorithmic part. 

Lemma 13 (Pinning). Let uj : [n] x D ^ U {_L} be a witness function of <1>. Then given any a € 
for some £ £ [n], we can construct a witness function for ^{a., *) in time polynomial in n. 

Lemma 14 (Projection). Let lo : [n] x D U {_L} be a witness function of ^. Given any i S [n], we 

can construct a witness function for Pr[^] <^ in time polynomial in n. 

When i is bounded by a constant, we can use uj to compute the projection Prj^j $ itself in polynomial 
time. Given an x £ Pr[^]<^, we can also compute a vector y G with x = Prj^jy in polynomial time. 

Let r = {<I>i, . . . , <I>/j| be an unweighted language over D. Then by Theorem[3l 7^CSP(r) is #P-hard 
if the relations in T do not share a common Mal'tsev polymorphism. Dyer and Richerby showed [13| that 
if all the relations in F share a common Mal'tsev polymorphism, then given any instance / of ^CSP(F), 
a witness function for the relation Rj that / defines can be constructed efficiently. 

Theorem 4. Let ip be a Mal'tsev polymorphism of all the relations in F, then given any input instance 
L o/^CSP(F), one can construct a witness function of Ri in polynomial time. 

2.9 Type-Partition Maps 

Finally, we define type-partition maps. Let S C L)" be a nonempty set and let 5i, . . . , 5^ be a partition 
of S, for some k > 1: the Si's are nonempty and pairwise disjoint, and S = SiD ■ ■ ■ U Sk. Then the pair 
{S, {Si, . . . , Sk)) defines the following type map type(-): Given any £ € [n] and x G D^, 

type(x) = <j e [k] -.By £ Sj such that x = Pr[^] 

y| ^ [k]- (9) 
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We usually call type(x) the type of x. When i = n, type(x) is either the empty set or a singleton. When 
i = n and type(x) is a singleton, we sometimes also refer to the element in type(x) simply as the type of 
X for convenience. 

Definition 7. Let type(x) be the map defined by (5, . . . , S^)) , then we say it is a type-partition map 
if for all £ € [n] and x, y € , type(x) and type(y) are either the same or disjoint. 

Now let type(-), as defined by (5, (Si, . . . , S^)) in @, be a type-partition map over D^, then we will 
refer to the following (n -|- l)-tuple 

1= {To,Ti,...,Tn), where Ti = {type(x) C [k] : x e and type(x) / 0} C 2^ . 

as the list of types of type(-). Here for the special case of £ = 0, we have To = 

Because it is assumed to be a type-partition map, we have \Ti\ < k for all i. It is also clear, from the 
definition, that all the sets in 7} are nonempty, since we are only interested in x € with type(x) ^ 0. 
It is easy to prove the following lemma: 

Lemma 15. Let type(-) be a type-partition map. Then for any £ : < i < n, 

U T=[k]. 

For any i,j -.0 <i < j <n and U eTi,V eTj, either V CU or U DV = (D. 

One way to better understand the list T is to consider it as a tree of height n: [k] € To is the root, 
and the sets of Te are nodes at level £ of the tree; U G Te and V € T^+i are connected if 1/ C [/. The tree 
has the property that the leaves are singletons and every other node is the union of its children. 

3 A Complexity Dichotomy for j^CSP with Complex Weights 

We now prove Theorem [TJ We start by describing the three necessary conditions for tractability. 

Let D = [d] be a domain and let J-" be a finite set of algebraic complex functions over D. We use Wjr 
to denote the following set of infinitely many (though countable) complex-valued functions: 

is a function defined by an input instance of #CSP(J-') and t : 1 < t < arity of -F|. 

The following lemma concerning Wj- is easy to prove: 
Lemma 16. For any finite subset T' C yVj, we have #CSP(J^') <t #CSP(J^). 

3.1 Hardness Part of the Dichotomy 

The hardness part of the dichotomy theorem consists of three conditions over Wj^. The violation of any 
of these conditions implies that ^CSP{J-) is ^^P-hard. First, we impose the following condition: 

Block Orthogonality: Let {Fi, . . . ,Fk} be any finite subset of Wj^, and let 
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F/,) =Pure(Fi,... 



Fk). 



Then for every F/ with arity > 2, we have F/ is block-orthogonal (and in particular, block-rank-1) . 
We prove the following lemma in Sectional 

Lemma 17. If does not satisfy the Block Orthogonality condition, then ^CSP{J-) is ^F-haid. 

Assume J- satisfies the Block Orthogonality condition. By Corollary [H every F in Wjr with arity > 2 
is block-orthogonal (and in particular, block-rank-1). Let n > 2 be the arity of F € Wj-, and let 

{(5i, vi), . . . , (5fc, Vfc)}, where Sj C D^~^ and vi, . . . , are linearly independent vectors, (10) 

denote the row representation of F. We have k < d because F is block-orthogonal. Let 



and let typep(-) denote the type map defined by the pair (^'_f, {Si, . . . , Sk))- 

Assuming F satisfies the Block Orthogonality condition. Here is the second condition on Wj^: 

Type Partition: For any F € Wjr of arity n >2, typep(-) is a type-partition map. 

We prove the following hardness lemma in Section [SJ 

Lemma 18. If F does not satisfy the Type Partition condition, then ^CSP{F) is ^P-hard. 

We also need a condition on relations defined from Wj-. Assume F satisfies the Block Orthogonality 
condition. Let F G Wj-, and = Boolean(F). If F has arity n > 2, we denote its row representation by 
pO]) and define the following relation on 2{n — 1) variables x = (xi, . . . , Xn-i) and y = (yi, . . . , yn-i)'- 

(x, y) S *^=^ X, y G Sj for some j S [k] F(x, *), F(y, *) are nonzero and linearly dependent 

This gives us the following set Ajr of infinitely many relations derived from the functions in Wj^: 



We now impose the last condition on Aj-: 

Mal'tsev: All relations in Ajr share a common Mal'tsev polymorphism : D. 

To finish the hardness part, we prove the following hardness lemma in Section [6l 
Lemma 19. If F does not satisfy the Mal'tsev condition, then #CSP(J^) is #P-hard. 

3.2 Algorithmic Part of the Dichotomy 

We show that if a finite set F of complex functions satisfies all three conditions: 

(a) the Block Orthogonality condition 

(b) the Type Partition condition 



^ip = SiU ■ ■ - U Sk 



^P : F eWjr\U iQp : F eWjr of arity > 2 
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(c) the Mal'tsev condition 

then there is a polynomial-time algorithm for ^CSP{J-). Theorem [1] then follows. 

First, by the Mal'tsev condition, all the relations in Ajr share a common Mal'tsev polymorphism. We 
may assume that such a polymorphism ip is given, and will use it later in the algorithm. 

Let / be an instance of #CSP(J-'), and let F : Che the function it defines. To compute Z{F), 

we examine the functions F = F^"!, . . . , F^'^\ For each F^, t : 2 < t < n, we use 

5M = {(5M,v^^1):j (11) 

to denote the row representation of F^^\ At this moment, we do not know what exactly st is, though by 
the Block Orthogonality condition, we know i^'*] G Wjr is block-orthogonal and thus, < st < d. 

Next by using the Mal'tsev condition, we know that (/? is a Mal'tsev polymorphism of ^p[t] , a relation 
over 2{t — 1) variables. The following lemma shows that f must also be a Mal'tsev polymorphism of the 
5'[*j]'s when viewed as relations over t — 1 variables: 

Lemma 20. If if is a Mal'tsev polymorphism ofil.p[t], then it is a Mal'tsev polymorphism of the S^^'^'^ 's. 
Proof. Let u G be a vector in S^'^'^^ (since S''*'-'! is nonempty). By the definition of ^pit], we have 

y ^ (u,y) gJ^^w 

As a result, S'l*'-'] = f]p[t](u, *), and the lemma follows directly from Lemma [T3j □ 

Now it makes sense to talk about witness functions for the S'^'-'l's (even though we still do not know 
St at this moment). We prove the following important algorithmic lemma in Section [7] and [8l 

Lemma 21. Assume T satisfies all three conditions with ip being a Mal'tsev polymorphism of A jr. Given 
an instance I offfCSP{J-), letting F : Z?" — t- C denote the function it defines, we can compute in polyno- 
mial time a sequence of n — 1 non-negative integers Sn, ■ ■ ■ ,S2 < d such that st is the number of pairs in 
the row representation of . Moreover, we can compute in polynomial time St pairs for each 2 < t < d: 

{{J''^\^r^''^^):jG[st]} (12) 

where u^^'^^ : [t - 1] x D ^ D^~^ U {_L} and vl*^] is a nonzero d-dimensional vector, such that 

1. jvt*'-^] : j G [st]} are exactly the st vectors in the row representation of F^^^; and 

2. ti;[*'-'l is a witness function of S^^'^\ the set paired with v^*'-'] in the row representation of F^^^. 

Once we have obtained sj and the pairs in (jl2p for each t, Z[F) can be computed efficiently: 

Lemma 22 (Computation of Z[F)). Given st and (|12p . Z{F) can be computed in polynomial time. 

Proof. For each t, we let pi|) denote the row representation of F^. By Lemma [211 all the vectors vl*'-'! 
in pip have been computed and for each set S^^'^\ we have computed one of its witness functions ojt*'-']. 
For any ai G -D, we will show how to compute F^^\ai) efficiently. The lemma then follows because 

Z{F)= FW(ai). 
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We start with an informal description of the algorithm. 

We first check whether ai € S'^'-'l for some j € [52]- This can be done efficiently as S2 < d is bounded 
by a constant and for each j G [^2], whether oi € 5^^'-^^ or not can be checked efficiently using the witness 
function wP'-'l of 3^"^'^^ By definition, if oi ^ S'l^'-'l for all j € [st], we must have F^'^\ai, *) = and thus, 

FW(ai) = ^F[2l(ai,6) = 0. 
beD 

Otherwise, let j € [st] be the unique index such that oi G /St^'-^^, and 02 G D be the smallest nonzero 
index of vl^'-^l. By the definition of row representation we have Ua2'"'' = 1- We also know that F^'^^{ai, *) is 
a nonzero vector and is linearly dependent with vI^'-^L Therefore, we have 

It reduces the computation of F^^^ai) to that of F^'^\ai, 02). If n = 2, then we are already done because 
-F'^] (oi, 02) can be evaluated efficiently using the input instance /. Otherwise we continue and reduce the 
computation of F^'^\ai,a2) to that of F^^\ai,a2,a^), for some appropriate 03 G D. 

Because -F[^1(oi,*) is nonzero and is linearly dependent with v^^'-^l, we have F^^l (01,02) 7^ and thus 
(ai, 02) G S^^'^^ for some j G [53]. By using the witness functions w'^'-'l, we can find this j G [53] efficiently 
and by definition, F^^\ai, 02, *) is nonzero and linearly dependent with v^^'-^'l. Let 03 denote the smallest 
nonzero index of vt^'-'l, then we have 

^;gj] = 1 and F^'\ai,a2) = F[3l(ai, 02, 6) = F^^\ai,a2,as) -J^v^'^K 

beD beD 

This further reduces the computation of F^^^ai) to that of F^^l (oi, 02, 03). After a total n — 1 rounds of 
such reductions, it suffices to compute F^"'\ai, . . . ,a„) for some appropriate 02,03, . . . ,0^ G D, in order 
to get fW(oi). This gives an efficient algorithm for F^^\ai) as F'"] can be evaluated efficiently using /. 

A formal recursive procedure called ComputeF is described in Figure [TJ It takes two inputs: t and a, 
where t : 1 <t <n and a G I?*, and outputs ^^(a). Its correctness can be easily proved by induction on 
t, and its running time is polynomial because the total number of recursive calls is at most n — 1 and in 
each call, the only non-trivial part is line 4 which has an efficient implementation by Lemma [TTl □ 

4 The Block Orthogonality Condition 

We prove Lemma [TTl in this section. We start with the following hardness lemma for pure functions and 
then use the Purification Lemma to generalize it to general functions: 

Lemma 23. Let F : Z?" C be a pure function with n > 2. If F is not block-orthogonal, then #CSP(F) 
is ^P-hard. 

Proof. Because F is pure, we let K denote the constant order(F). Without loss of generality, we assume 
that F is block-rank-1 since otherwise, ^CSP{F) is #P-hard by Lemma |H 

Now assume F is not block-orthogonal. Then by definition, there exist x, y G D^~^ such that the two 
vectors F{x, *) and F{y, *) have at least one common non-zero entry, but are neither linearly dependent 
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ComputeF (t, a) , where t : I < t < n and a G 



1. if t = n then 

2. use the mput instance / to evaluate i^["](a) = -F(a); output F{a.) and exit 

3. end if 

4. use j G [st+i], to check if there is a j G [st+i] such that a G S'[*+^'''l 

5. if no such j G [st+i] exists then 

6. output and exit 

7. else 

8. let j G [st+i] be the unique index such that a G S'[*+^'-?] 

9. let ot+i G -D be the smallest nonzero index of v^^+^'-^l 

10. compute ^1*+^] (a, at+i) = ComputeF (t + 1, a o 04+1) with a recursive call 

11. output the following and exit 

12. end if 

Figure 1: The recursive procedure ComputeF 



nor block-orthogonal. Because F is block-rank-1, we have F{x,i) = if and only if F{y,i) = 0. We use 
T C. D to denote the nonempty set of z G -D such that F(x, i) is non-zero. As F is pure and block-rank-1 
we can partition T into Ti, . . . , for some 1>1 and there are positive a,b, fii > ■ ■ ■ > fi^ > such that 

F(x, i) = a ■ fj,j • c(x, i) and F{y, i) = b ■ fij ■ c(y, i), for all j G [£] and i GTj, 

where c(x, i) and c(y, i) are all roots of unity whose orders divide K. 

To show #CSP(F) is #P-hard, we let A^, for each r > 1, denote the following cP~^ x d""^ matrix: 

^^(w,w') = ^F(w,i) • (F(w',i))''^"\ for ah w,w' G Z)"~\ 

and prove that for every r > 1 (note that the square matrix A^ here is not necessarily symmetric), 

EVAL(Ar) <r#CSP(F). 

Given any input directed graph G = {V, E) of EVAL(Ar), we construct / with the following variables: 

Zy^i, . . . , Zy^n-iiWe, for all G ^ and e G E, 
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ranging over D. Then for each edge e = uv G E, we apply 

F over {zu,i, . . . ,Zu,n-i,We) and {rK - 1) copies of F over {z^^i, . . . , z^^n-i,We). 

The reduction then fohows because Za^(G) = Z{Fj), where Fj denotes the function that I defines. Now 
to prove that ^CSP{F) is #P-hard, it suffices to show that EVAL(Ar) is ^P-hard for some r > 1. 
Focusing on the 2x2 sub-matrix of indexed by x and y, we have 

A(x,x) = E E (« • ci^^i)^ = E i^ii • (z^^)''" 



and 



A(y,y) = E E • = ^'"^ E i^^i • (z^^)'''" 

3m ieT, jeM 



while 



-4r(x,y) = ^ ^ a • /ij • c(x,i) • (6 • //j • c(y,i))'' =a-lf^ ^ ^if^jY^ E "^(^'^^ ' 

and 

Ar(y,x) = ^ E ^ ■ ■ "^(^y'^) ■ ("^ ■ ■ = a'"'^"^ • ^(^j)'"-^ ^ c(y,i) • c(x,i) 

We use L to denote 

^(/x,r^5;c(x,i).<^ 

Since all the /ij's are positive, we have 

A.(x,y).A(y,x) =a'-^-6^^-|Lp. 
We discuss the following three cases. First, if 

\L\ = \Tj \ ■ {fj.jY^ , for some r > 1. 

then by Cauchy-Schwarz, it must be the case that c(x, *) and c(y, *), as two |T|-dimensional vectors, are 
linearly dependent and thus, F{x,*) and F{y,*) are linearly dependent, contradicting the assumption. 
Second, if L = for all r > 1, then by solving a Vandermonde system, it must be the case that 

c(x, i) ■ c{y,i) =0, for all j G [i] . 
As a result, these two rows are actually block-orthogonal, contradicting the assumption again. 
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Otherwise, we must have 

< |L| < ^ \Tj \ ■ injY^, for some r > 1. 

So all the four entries of this sub-matrix of |Af.| are positive but its rank is 2. This implies that \A.r\ is 
not a block-rank-1 matrix. By LemmaO we have EVAL(Ar) is ^^P-hard and so is #CSP(-F). 

This finishes the proof of the lemma. □ 

Lemma [T71 then follows from Lemma \23\ Lemma [TBI and Lemma [71 

Proof of Lemma \17\ Assume J- does not satisfy the Block Orthogonality condition. 

Let {Fi, . . . ,Fk} C Wjr be a finite set that violates the Block Orthogonality condition. Let 

(F^...,F^) = Pure(Fi,...,Ffc), 

then by Lemma [3 and Lemma [T6l we have for each i € [k], 

#CSP(i^') <T #CSP(F{ , . . . , F^) =T #CSP(Fi, . . . , Ffc) <r #CSP(^). 

If F/ is not block-orthogonal, then by Lemma[23l 7^CSP(F/) is #P-hard and so is #CSP(J-'). □ 

5 The Type Partition Condition 

We prove Lemma [THl in this section. 

Again, we start by working on pure functions. Let F : D" C be a pure function where n > 2. Also 
assume that F is block-orthogonal (and in particular, block-rank-1 as well). 

Let 5 = {(5i, vi), . . . , {Sk, Vfc)} be the row representation of F, where Si, . . . , Sk Q -D""^, and let 

^ = SiU-'-uSk- 

From the pair {"^, {Si, . . . , Sk)), we define the type map type(-): For any £ £ [n — 1] and any x G D^, 

type(x) = |j G [A;] : 3y G 5^ such that x = Prj^jyj. 
We show that if type(-) is not a type-partition map, then ^CSP(F) is ^P-hard. 

Lemma 24. Let F : D" —^Cbea pure and block- orthogonal function with arity n > 2, then the problem 
#CSP(F) is #P-hard if there exist an £ ^ [n — 1] and x, y G such that 

neither type(x) n type(y) = nor type(x) = type(y). (13) 

Proof. We start with some notation. Let K be the constant order(F). 

Because S is the row representation of F, there is a function g : ^ C such that 

F(x, *) = g{x.) ■ Vj, for all j G [k] and x G 5j. 
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By the definition of row representation, ^(x) is exactly the first non-zero entry of F{x, *). 

As F is pure, ^(x) is the product of a positive integer and a root of unity whose order divides K, for 
all X G This then implies that all the nonzero entries of vi, . . . , are products of a positive rational 
number and a root of unity whose order divides K. 

Moreover, we know that for any i ^ j (z [k], it follows from Lemma [5] that 

V^,a ■ {VjX-' = 0, (14) 

because they are not only orthogonal but also block-orthogonal. For each j G [k], we let Cj > denote 

Now we start the proof. Let i ^ [n — 1] and let x, y € be two vectors that satisfy (jl3p . Note that 
if £ = n — 1, then type(x) is either the empty set or a singleton set. Therefore, to satisfy (fT3]) . i has to be 
smaller than n — 1. Without loss of generality, we let 

type(x) = Li U L2 and type(y) = Li U L3, 

where Li and at least one of -^21-^3 are nonempty and they are pairwise disjoint subsets of [k]. 
Let A denote the following x matrix: For z,w G D^, the (z,w)*'^ entry of A is 




It is easy to see that A is symmetric. We can then use the following construction to show that 

EVAL(A) <T #CSP(F). (15) 
Given any undirected graph G = {V, E), we construct an instance / with the following variables: 

vi,...,ve for each v £ \V\ and pe,qe,Se,e+i, ■ ■ ■ ,Se,n-i,re,£+i, ■ ■ ■ ,re^n-i for each e G \E\. 
For each e = uv E, we apply one copy of F over 

(ui, . . . ,Ui,Se/+l, . . . ,Se,n-l,Pe) and {vi, . . . ,ff,re,£+i, . . . ,re^n-l,qe); 

and apply {K — 1) copies of F over 

(ni, . . . ,Ui,Se/+l, . . . ,Se,n-l,qe) and {vi, . . . ,Vi,re/+l, . . . ,re,„_l,Pe)- 

It then follows from the construction of A from F that Z\{G) = Z{Fi) where Fj is the function that / 
defines, and (jlSp follows. To finish the proof, it now suffices to show that EVAL(A) is #P-hard. 
For this purpose, we analyze the four entries of A with z,w G {x, y}. 

For each i G type(x) = Li U 5 we let Ui denote the nonempty set of vectors x' G such that 
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X o x' € Si. And we define Vi similarly for y. Then for i ^ j G Li U L2 and z' G CZ/, w' G Uj, we have 



^F(x,z',p).(F(x,w',p))^-^ = 
by (|14p. This can be used to simplify the sum in A(x, x) as follows: 



^(x,x) = ^g(x,x')ui,p- (5f(x,x")wi,p) ^ (fi((x,x')?;i,g) •5((x,x")^ 

iGLiUL2 x',x"GC/i \pGZ) / \gG-D 

2 

= E E k(x,x')|^-Kx,x")r-(Q)^= E I E k(-'-')r-^«' 

iGLiUL2 x',x"Gf/i ieLiUL2 \x'e(7. 

Similarly, using the same argument, we have 

2 

^(y'y)= E E \9iyy)f-\9{y,y")f-(^^f= E I E M^'^')!" ^ 



On the other hand, by a similar proof, we also have 



^(x,y) = E E \^9{^,^') ■Vi,p- {g{y,y') -Vi^p) ^ (5(x,x') • Vi,^) ■g{y,y')- 



= E E kx,x')r •|5(y,y')| -(q)^ 

iGLi x'gC/i,y'GVi 

= E E k(x,x')|^-ci ^ |5'(y,y')|^ • Ci 

iGLi \x'GC/i / \y'GVi 

and A(y,x) = A(x, y) (since the construction is symmetric). Because Li is nonempty, we have 

^(x,y) = A(y,x) >0. 

It is now easy to see that if at least one of the L2, is nonempty, then we have 

A(x, x) • ^(y, y) > ^(x, y) • A{y, x). 

By Theorem [21 we have that EVAL(A) is ^P-hard and so is #CSP(F). This proves the lemma. □ 

Finally, we use the Purification Lemma to prove Lemma [TSl 

Proof of Lemma I j<gl Without loss of generality, we may assume that T satisfies the Block Orthogonality 
condition (since otherwise, ^CSP(J-') is ^^P-hard by Lemma [TT]) . 
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Let F G Wjr be a function of arity > 2, and let F' = Pure(F). By Lemma [161 

#CSP(F') =7-#CSP(F) <7-#CSP(7-). 

As J- satisfies the Block Orthogonality condition, F' is block-orthogonal. From Corollary [T] of the Purifi- 
cation Lemma, F and F' induce the same equivalence relation and and therefore, the type map 
type^(-) and type^/(-), induced by F and F' , respectively, are the same. If type^(-) is not a type-partition 
map, then neither is type^/(-). By Lemma [Ml #CSP(F') is #P-hard and so is #CSP(J-'). 

This finishes the proof of the lemma. □ 



6 The Mal'tsev Condition 

We prove Lemma [19] in this section. It follows directly from the following lemma: 

Lemma 25. If J- satisfies the Block Orthogonality condition, then for any finite T C Ajr, we have 

#CSP(r) <T #CSP(J-). 

Proof of Lemma [7Pi If T does not satisfy the Block Orthogonality condition then we are done by Lemma 
[T71 Assume F satisfies the Block Orthogonality condition but does not satisfy the Mal'tsev condition. 
By Corollary [21 there exists a finite set T C Ajr with #CSP(r) being ^P-hard. Then using Lemma 
we know ij^QSP{F) is also #P-hard, and the lemma is proven. □ 



Now we prove Lemma [ 

Proof of Lemma[2R Given T, we can find a finite subset {Fi, . . . , F^j C Wj- such that F C A, where 
A = = Boolean(i^i) : i G U : i e [k] and the arity of Fi is > 2|. 

We use Tj > 1 to denote the arity of Fi. Here ili is the following relation over 2(rj — 1) variables: 
(x, y) G <^=^ Fi{x, *) and Fi{y, *) are non-zero and linearly dependent 

By Lemma \W[ we have 

#CSP(Fi,...,Ffc) <T#CSP(.F), (16) 

so we only need to give a polynomial-time reduction from 7^CSP(A) to ^CSP(^Fi, . . . ,-Ffc). 
To this end, we first apply the Purification Lemma to get 

= Pure(Fi,...,Ffc). (17) 

All the new functions F[. . . ,F'j^ are pure, and we have 

#CSP(F^, . . . , Fl) =7- #CSP(Fi, . . . , Ffc). (18) 

We use K to denote the least common multiplier of the orders of all the pure F/'s. 
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The plan of the proof is the following. For every i S [k] with > 2, we use a construction to define, 
from F^, a 2(rj — l)-ary function Hi and prove that 

#CSP({i^' : i € [k]} u{H,:ie [k] and r, > 2}) <t #CSP(F{, . . . , F^). (19) 

We will also show that for every i € [k] with rj > 2, 

Qi = Boolean(i?i). (20) 

On the other hand, by Property 2 of the Purification Lemma, we know that 

$i = Boolean(Fi) = Boolean(i^')> for all i € [k]. 

As a result, by Lemma O we have 

#CSP(A) <T #CSP({i^' : i G [A;]} U : i € [k] and r, > 2}), (21) 

and the lemma fohows by combining (f2T]) . (fT9]l . (fTSl) and (fT6]l . 

For each i € [A;] with rj > 2. We use i/j to denote the following function: 

Hi{^,y) = ^ Fl{^,z) ■ {Fl{y,z)f-\ for ah x,y € ^''-^ 
zeD 

We now use the following construction to show (jl9p . Given any instance / of the first problem in (jl9p we 
construct an instance /' as follows. We start with the same set of variables as /, and add all the tuples 
in / whose function is to /'. For each other tuple in /, i.e., {Hi, xi, . . . , Xr^-i,yi, . . . , y-r—i), we create 
a new variable z and then add the following K tuples to /': 

{Fl,xi,...,Xr^_i,z) and (K - 1) copies of (i^', yi, y^.-i, z) . 

It is easy to show that Z{Fj) = Z{Fji) where Fj, Fji are the functions defined by /, /', and (|19p follows. 

Finally we prove (|2Up . As J- satisfies the Block Orthogonality condition, (|17p implies that F^' is block- 
orthogonal. From this, it follows from Lemma [5] that 

Hi{x,y) 7^ <^=^ *) 'iiid F/(y, *) are nonzero and linearly dependent 

Using Corollary [H the two equivalence relations '-^f^ and ^p', induced by Fj and F/, respectively, are the 
same. Therefore, F/(x, *), F/(y, *) are nonzero and linearly dependent if and only if Fj(x, *), Fj(y, *) are 
nonzero and linearly dependent. This proves (|20p and finishes the proof of the lemma. □ 

7 Polynomial-Time Operations on Witness Functions 

In this section, we present three useful polynomial-time operations on witness functions of relations that 
share a common Mal'tsev polymorphism. They will then be used later in Section [8] to prove Lemma [211 
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7.1 Variable Permutation of Witness Functions 



Lemma 26 (Variable Permutation). Let $ C be an n-ary relation. Let f be a Mal'tsev polymorphism 
of ^ and CO be a witness function of ^. Then given any permutation ir over [n], we can compute a witness 
function lo' for 7r(<l>) in time polynomial in n. 

Proof. It suffices to show that, given any i € [n — 1], we can construct a witness function oj' for 
^' = • • • 'Oi'^j+i' • • • )«n) (oi, . . . ,ai+i,ai, ...,an) G ^>|. 

in time polynomial in n. For each j G [n], we use ~j and to denote the equivalence relations defined 
by $ and <^>', respectively. Clearly for j ^ i or i + 1, is the same as ~j and thus, we can set 

uj'{j, a) = uj{j, a), for all a G -D. 

Next we compute Let b G Prj<I>' = Prj+i^. Note that the latter can be computed efficiently from 
ui. We want to compute the class S of b in ~. and in addition, a witness for each 6' G that shares the 
same {i — l)-prefix. We are then done for £ by setting uj'{i,b') to be this witness for every b' G £. 

To this end, we denote a;(i + 1, 6), a witness for (z + 1, 6) in $, by 

xoao6ouG<I>, where X G -D*~\ a G -D and u G -D"'"*"^ (22) 

We then use Lemma [13] to compute a witness function for <I?(x, *) on n — {i — 1) variables, and use it to 
project $(x, *) on its second coordinate: Pr2$(x, *). We now show that £ = Pr2<l*(x, *). 

Clearly every b' G Pr2 <&(x, *) satisfies b' ~^ b, because b' G Pr2 *^*(x, *) implies that there is a witness 
for (i + 1, b') in <^ with the same prefix x. Now suppose b' ~^ b, then by the definition of there exist 
a y G D^~^ and ai, 02 G D, ui, U2 G such that 

y o ai o 6' o ui G and y o 02 o 6 o U2 G 

Applying the Mal'tsev polymorphism ip on these two vectors together with the one in ()22p then gives a 
witness for (i + 1,6') in $ with x as its prefix. This means that b' G Pr2$(x, *). 

Now we have computed the equivalence class £ of b. We can also use the witness function of <^*(x, *) 
to get a witness for (i + 1, b') in <I> with x being its prefix. This finishes the construction of uj'{i, *)■ 

Finally, we work on ^[^i- Let a G Prj-|_i<I>' = Pr,<&, then we want to compute the equivalence class £ 
of a in ~^_j_x. We denote the vector ui(i,a) by 

xoao6ouG$, where X G £>*"\ 6 G -D and u G Z)""*"^ (23) 

We use Lemma [13] to compute a witness function of <l>(x, *) and then, Pr^j *^*(x, *). For every pair in 
(a', b') G Pr[2] ^(x, *), we also compute a vector in $(x, *) which starts with a' and 6'. We then collect all 
the a' ^ D such that for some b' G both (a', 6'), (a, b') G Pr^] *^*(x, *), and claim that this is exactly £. 

First, it is easy to see that if (a', 6'), (a, b') G Pr[2] $(x, *) for some b' G D, then a a'. Conversely, 
if then there are y G Z?'""*^ and c G D, Ui, U2 G such that 

yoaocouiG$ and y o a' o c o U2 G 
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Applying the Mal'tsev polymorphism ip on these two vectors together with the one in ()23p then gives a 
vector in ^> with prefix x o a' o 6. This implies that (a', b) G Prp] *l*(x, *). 

We have computed the class £" of a in For each a' ^ E with (a', h'), (a, h') G Pr^j '^(x, *), we can 

compute two vectors in $ with prefixes x o a' o 6' and x o a o 6'. Applying the Mal'tsev polymorphism 
on these two vectors together with the one in (|23p gives a vector in <1> with prefix x o a' o 6. As a result, 
we obtain a witness of {i + 1, a') in <!>', for every a' € 8, which shares the same prefix x o 6. We then set 
uj'{i + 1, a') to be this witness for each a' G 8, and this finishes the construction of uj'{i + 1, *). □ 

7.2 Union of Witness Functions 

Let ^'i, . . . s be s pairwise disjoint relations over n variables xi, . . . , € D. Also assume that 99 is a 
Mal'tsev polymorphism of all the ^'fc's. Let 

$ = U • • • U 

In general, 93 may not be a Mal'tsev polymorphism of However, the following lemma shows that if it 
is assumed that is a Mal'tsev polymorphism of $ as well, then we can construct a witness function of 
$ from witness functions of the efficiently. 

Lemma 27. Let ^1, . . . , ^'^ he pairwise disjoint and nonempty subsets of D"^ , and /ei <1> = "fi U • • • U ^'s- 
Also assume that ip is a Mal'tsev polymorphism of both $ and the 's. Given a witness function of 
for each k G [s], we can construct a witness function u of ^ in polynomial time (in s and n). 

Proof. Pick any pair (i, a) € [n] x D. We first decide whether there is a vector x € <^ such that Xj = a. 
As <^ is the union of the ^fc's, it suffices to check if ujk{i, a) ^ _L for some /c € [s]. If a) = _L for every 
€ [s], then we simply set uj{i, a) = _L; otherwise we have computed a witness in $ for (i, a). 
Next for each i G [n] we compute the equivalence relation ~j of <5 as follows. Pick any a ^b ^ D for 
which we have already found witnesses x, y in with Xi = a and yi = b. By Lemma [TUl we have 

a r-^i b 3 z e $ such that Pr[j]Z = (xi, . . . , Xj-i, 6) 

Because <I> is the union of the ^kS, it happens if and only if there exists such a z € ^fc for some /c S [s]. 
To check whether has such a z, by Lemma [131 we can use Uk to construct a witness function for 

^'fc(xi,...,Xi_i,6, *). 

Then has a z with Prjjjz = (xi, . . . , Xj_i, 6) if and only if the witness function we get is nonempty. 
It is clear that the computation of ~j, i G [n], also gives us a witness function lo for <I>. □ 

7.3 Splitting a Witness Function, with the Type Partition Condition 

Here we describe the inverse of the union operation described above. The setting is the following. 

Let <^ C be a nonempty relation over n variables. And let ^'i, . . . , ^'^ be an s-way partition of $, 
for some s € [d]: The ^'j's are nonempty, pairwise disjoint, and satisfy 

$ = ^1 U • • • U ^'s. 
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Assume that 93 is a Mal'tsev polymorphism of $ and all the ^j's. 

At the beginning, we have completely no information about the sets 'I'i's. Even the number s of sets 
is not given, though we do know that s € [d]. The only resources we have are a witness function u for 
$ and a black box to query: We can send any x € $ to the black box and it returns the unique k € [s] 
such that X G ^fc. The question then is: Can we use w and the black box to compute s G [d] as well as a 
witness function ojk for each in polynomial time and only using polynomially many queries? 

In general, we do not know how to solve this problem efficiently. But if the following condition holds 
then it has an efficient algorithm. Here given any permutation vr on [n], we use type,^ to denote the type 
map defined by (7r(<l>), (7r(^i), . . . ,7t{^s))), that is, 

type^(x) = |A; € [s] : 3 y € 7r(^fe) such that Pr[^]y = x|, for all x e with £ G [n]. 

We also set type^{e) = [s], where e denotes the empty string. 

Our condition requires that type^(-) is a type-partition map for all permutations vr over [n]: 

Lemma 28. Let ^1, . . . , ^'^ be an s-way partition of ^ , for some s G [d]. Assume (p is a Mal'tsev 
polymorphism of ^ and the ^'^ 's, and type^(-) defined above is a type-partition map for any permutation 
TT on [n] . Then given a witness function u of ^ and a black box specified above, we can compute s G [d\ as 
well as a witness function uj^ of each '^^ polynomial time and using polynomially many queries {in n). 

We start with some definitions and lemmas. 

We use type(-) to denote type^(-) with vr being the identity permutation for short, and use 

1= (TcTi,...,?;), where 7^- = {type(x) C [s] : x G Pry]^>} 

to denote the list of types of type(-). Since type(-) is a type-partition map, we have \Tj \ < s < d for all j. 
It is clear that all the Tfs are nonempty because <I> is nonempty; every set in Tj is a nonempty subset of 
[s] because we are only interested in x G Pi'y]*^' in the definition above. 
We need the following definition in the algorithm: 

Definition 8. We say 6 = (5o,5i, . . . is a partial list of% if Sj C Tj for all j ■ < j < n. 

Given U (z Ti for some < i < n, we say & is closed with respect to U at level i, if U Si and for 
every j > £, we have V G Sj for any V G Tj with V U. 

Finally we say 6 is closed if it is closed with respect to every U G Sj at level j, for all j : < j < n. 

In particular, 6 is closed if Sj = for all j. It is easy to show from the definition that 

Lemma 29. If & is a closed partial list o/T and Sq has the set [s], then 6 = T. 

Proof. We use induction on j = 0, 1, . . . , n. The base case is trivial as by assumption, 5o = To = { [«]}• 

Now assume that Sj = Tj for some j > 0. As (3 is a partial list of T, to show 5^+1 = TJ+i, it suffices 
to prove that V G for any V G Tj+i- By the earlier discussion on the tree structure of T in Section 
12.91 there is a unique set U Tj such that V ^U. By the inductive hypothesis, U (z Tj = Sj and hence, 
V G as 6 is closed. This finishes the induction and the proof of the lemma. □ 

We present a recursive procedure ComputeType for computing both s G [d] and T, using the witness 
function a; of $ and the black box. The procedure is given formally in Figure [2j It takes two inputs: 
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(i) a vector x G Pr[£]^>, where I : < I < n (and x = e when ^ = O) ; and 

(ii) a closed partial list 6 = {Sq,Si, . . . of T. (Note that during the execution of 
ComputeType, it sometimes updates the hst & by adding new sets to the 5j's.) 

We analyze the procedure ComputeType and prove the fohowing lemma: 

Lemma 30. Let x € Pr[^]*& for some i : < I < n and let & be a partial list o/T, then we have 

ComputeType(x, ©) =type(x). 
Let & = {Sq, S'l, . . . , denote the tuple & after the execution of ComputeType(x, 6), then we have 

type(x) G S'f, and Sj C 5j, for all j :0<j <n. (24) 
Moreover, if & is a closed partial list ofZ, then so is &'. 

Proof. We prove the lemma by induction on^ = n,n — 1,...,1,0. The base case when £ 
6 remains a closed partial list of T if a singleton set {k} G Tn is added to Sn- 

Assume the lemma holds for all calls to ComputeType with vectors x of length i + 1, 
i > 0. We now show that if x G Prj£]<I> and S is a partial list of T, then 

ComputeType(x, 6) = type(x) 

and the new tuple & after the execution satisfies (|24p. In addition, if 6 is closed then so is & . 

There are two cases to discuss. First if the algorithm reaches line 9 then we clearly have type(x) = U 
since type(-) is a type-partition map and the input tuple S is assumed to be a partial list of T. Also the 
properties about &' hold because 6' = S in this case. 

Otherwise, the algorithm uses the for-loop to get Ua for each a G Pri<I>'. By the inductive hypothesis, 
we know that at the end of each iteration of line 12, S remains a partial list of T. After the for-loop, we 
have Ua = type(x o o) and 6 is a partial list with type(x o a) G 5^+1 for all a G Pri<l>'. 

As a result, we have by line 18 and line 21 that 

ComputeType(x, S) = [/ = [_J Ua = type(x o a) = type(x). 

aGPri<I>' aePri<I>' 

It is easy to show that after the execution, &' remains a partial list of T and satisfies (j24p . Next, assume 
that the input 6 is closed. By the inductive hypothesis, & remains closed before line 22 and we have 

type(x o a) G for all a G Pri$'. 

Therefore, before and after line 22 6 is closed with respect to type(x o a) at level i + 1 for all a G Pri<I>'. 
Also notice that these are all the subsets of type(x) in Te+i- It follows that & remains closed after adding 
type(x) to in line 22, because 6 remains closed with respect to type(x) at level i. 

This finishes the induction and the proof of the lemma. □ 

Proof of Lemma \28l We start the proof of Lemma [25] now. 



= n is trivial as 
. . . , n, for some 
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ComputeType (x, ©) , where x G Pr[£] $ and £ : < £ < n 



1. \f i = n then 

2. query the black box to get the k G [d] such that x G ^'fc 

3. add {k} to 5„ if {/c} ^ 5„; output {/c} and exit 

4. end if 

5. compute a witness function tj' of = . . . , x^, *) = $ if x = e and ^ = O) 

6. use uj' to find a vector y G D"^^ such that x o y G 

7. query the black box to get the k G [d] such that x o y G ^'fc 

8. if k belongs to one of the subsets U in Sg then 

9. output U and exit 

10. else 

11. use uj' to compute Pri$' = {6 g -D : tj'(l,6) /-L} 

12. for each a G Pri$' 

13. let z = uj'{l, a) G D"'~^ (and we have zi = a and x o z G 

14. query the black box to get the k G [d] such that x o z G ^'^ 

15. if k belongs to one of the subsets in Sg^i then 

16. denote this subset of by Ua (and we have type(x o a) = Ua) 

17. else 

18. let Ua = ComputeType(x o a, &) 

19. end if 

20. end for 

21. let C/ = UaGPri$'f^a 

22. set Si to be Si U {U}; output U and exit 

23. end if 

Figure 2: The recursive procedure ComputeType 



From Lemma [30l we can call ComputeType(e, 6) with Sj = in © for all j, to get the number s G [d] 
of ^fc's as it outputs type(e) = [s]. By the end of its execution, we also have type(e) G Sq and & remains 
a closed partial list of T. It then follows from Lemma [29] that 6 becomes exactly T. 

Next, we show that ComputeType(e, 6) actually runs in polynomial time, and only uses polynomially 
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1 . use u) to find a vector y G such that x o y g <I) 

2. query the black box to get the integer k € [s\ such that x o y G ^'fc 

3. use k to find a subset C/ in 7^ such that k 

Figure 3: Computation of type(x) using % 

1. for every a (z D such that x o a G Pr[£^;^]<l> 

2. compute type(x, a) 

3. if A; € type(x, a), then recursively find a z such that x o a o z G ^fc, and output a o z 

4. end for 

Figure 4: Finding a y such that x o y g vj/^^ where A; € type(x) 

many queries to the black box. Notice that the running time and number of queries used in each call to 
ComputeType, excluding those spent in the recursive calls in line 18, are bounded by a polynomial in n. 

We now show the following statement: during each recursive call to ComputeType in line 18, at least 
one new set is added to one of the Sj^s in 6. This is because each recursive call to ComputeType in line 
18 has the following property: The index k obtained in line 14 belongs to type(x o a) by the definition of 
z in line 13 and the definition of k in line 14. The fact that we reach line 18 means that the condition in 
line 15 fails and thus, k ^ any set in Si^i before the execution of ComputeType in line 18. But after the 
execution of ComputeType in line 18, k G the set type(xo a) € the updated Si+i. The statement follows. 

As a result, each recursive call of ComputeType in line 18 strictly increases the cardinality of (3, but 

n n 

^\Si\<^\Te\<l + dn = 0(n), 

because \Tt\ < d for every £ S [n] and |7o| = 1- Hence, there can be at most 0{n) recursive calls in every 
execution of ComputeType(x, S). Therefore, we conclude that the total running time and the number of 
queries to the black box used by ComputeType(e, S) is polynomial in n. 

We have computed s G [d\ and T. With T, we can compute type(x) for any x € Pfj^j^ in polynomial 
time. The algorithm is described in Figure [3l Since type(-) is a type-partition map, by the definition of 
T, we know there is a unique U £ Ti such that k £ U, and we have type(x) = U. 

Moreover, given any x € Pr[£]$ and k G type(x), we can find recursively and in polynomial time a y 
such that X o y G ^ij,. The algorithm is described in Figure HI 

Let vr be any permutation on [n]. By the assumption of the lemma, type^(-) is also a type-partition 
map. We note that all the algorithms in Figure [21 [3] and [H still work correctly, even if we replace type(-) 
by type^(-) and replace the witness function of <1> by a witness function a;,^ of 7r(<I>). Also note that 
can be computed from u efficiently using Lemma [251 

Now pick any k £ [s], and we start to construct a witness function Uf^ for ^'fc. 

Pick any pair (i, a) with i £ [n] and a £ D. We use tt to denote a permutation over [n] with 7r(z) = 1. 
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Then by using the first two algorithms in Figure [2] and [3l we can compute type^{a). We use type^(a) to 
determine if o G Prj as follows. If A; G type^(a), then a G Prj ^t^, and we use the algorithm in Figured] 
to find a witness in for {i,a); Otherwise, no such witness exists and we set ujk{i,a) = _L. 

To derive the equivalence relation ~j defined by we pick a, 6 G Prj^fc and use x, y G ^'fc to denote 
the witnesses in "if^ we have found for (i, a) and (i, b). Then we use the algorithm in Figure [3] to check if 

k G type(^(Pr[i„i]x) 06^ 

It is then easy to show that a ~j 6 if and only if G type((Pr[j_i]x) o 6). This gives us the relation ~j. 
Finally, we can also use the algorithm in Figure H] to find a vector x', for each b ~j a, such that 

(Pr[i_i]x) obox' £^k- 

This finishes the construction of Uj., and the proof of Lemma [28l □ 

8 Proof of Lemma [2T 

With all the operations for witness functions developed in the last section, we now prove Lemma [2T1 
For each ^ : 2 < ^ < n, we let = Boolean (F^), and use 

{(5[^'^],v[^'^l):jeN} 

to denote the row representation of F^^'^. 

We now show how to compute efficiently sg G [d], a witness function LOe for and 

in polynomial time for all 2 < £ < n such that cjl^'-'l is a witness function of S'l^'-'l for all £ and j. Here it 
makes sense to talk about witness functions for and S'l^'-'l since by the Mal'tsev condition and Lemma 
[20} 93 is a Mal'tsev polymorphism of all these sets. 

We use induction on i = n, . . . ,2. We start with the base case i = n. Let J- = {/i, . . . , fh} and let 
denote a Mal'tsev polymorphism shared by relations in Ajr and thus, 93 is a Mal'tsev polymorphism of 

|Boolean(/i), . . . , Boolean 

Therefore, by Theorem we can construct a witness function oJn efficiently for 

= Boolean(F["]) = Boolean(F), 

because = Boolean (F) is the relation defined by an input instance of the unweighted 

#CSP(Boolean(/i), . . . , Boolean(A)) . 



36 



Using we can construct a witness function for ^„ = Pr[„_]^]$„ using Lemma [TH Because 
denotes the row representation, we have 

Now let vr be any permutation from [n — 1] to itself. We define the following type map type^(-): 

type^(x) = |j € [sn] : 3 y e 7r(5''"'''l) such that Prj^jy = x|, for x € Z?"' and re [n - 1]. 

By the Type Partition condition, we know that type^{-) is a type-partition map, for any permutation vr. 
This follows from the fact that, given any function in Wj-, we can arbitrarily permute its variables and 
the new function still belongs to Wj^. 

Therefore, we can now use Lemma [28] to compute s„ € [d], and construct a witness function cjl"'-'! for 
each £'["'■'1, j S [s„]. Notice that the black box that Lemma [28] needs to query can be implemented quite 
trivially here: given any x G D^~^, we can evaluate the vector F(x, *) efficiently using the input instance 
/. The black box keeps all the linearly independent vectors F{x, *) evaluated so far and associates each 
of them with a unique label j G [sn]- With cjt"'-'] computed, we can use it to get a vector x G 51" J1, and 
then evaluate -F(x, *) to get the representative vector v^"'-'!. 

Assume for induction that for some i : 2 < i < n, we have computed St, a witness function of $t and 

for all t = £ -\- 1, . . . ,n such that wl*'-'! is a witness function for S^'^'^h To work on F^^\ we notice that 

FM(x) = ^F[^+i](x,a). 

As a result, we have i^[^](x) 7^ if and only if x G S^^'^^'^^ for some j G [sg+i] and 

aeD 

We let -L denote the subset of [s^+i] such that j G L if the sum above is nonzero, then we have 

= Boolean (fM) = \J S^'+^'^l 

Using the Mal'tsev condition and Lemma [2U] we also know that ip is a Mal'tsev polymorphism of and 
the 5[^+1'J1's. By using Lemma [23 as well as the witness functions u^^^^'^^ for S^^~^^'^\ we can compute a 
witness function uji of efficiently. 

Next, we use loi and Lemma [TJ] to construct a witness function u'^ for 
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a relation over I — 1 variables. Because 



denotes the row representation of F^^\ we have 

Similarly, given any permutation vr from [i — 1] to itself, we define the following type map: 

type^(x) = |j G [si] : 3 y G Tr[S^^'^^) such that Pr[,.]y = x|, for x G and r e [i - 1]. 

By the Type Partition condition again, typej^(-) is a type-partition map for any permutation vr. 

But before we can finally use the algorithm of Lemma [28] to compute se G [d] and construct a witness 
function o;!^'-'! for each S'^'-'l in the row representation, we need to first show how to implement the black 
box efficiently. For this purpose, it suffices to give an efficient algorithm for computing F^^\x), x G D^. 

This can be done by calling ComputeF(£, x), the polynomial-time algorithm described in the proof of 
Lemma [22] in Figure [1] Notice that the execution of ComputeF(^, x) uses s^+i, . . . , Sn and the pairs 

|(^M^v[*'J1) : £ + 1 < t < n and i G [st]}, 

all of which have already been computed by the inductive hypothesis. Now we can use the algorithm in 
Lemma [28] to compute S£ and the pairs (w'^'-'l, v'^'-'l) . 
This finishes the induction and the lemma is proven. 

9 Conclusions 

We proved a complexity dichotomy theorem for ^CSP with complex weights. To this end, we introduced 
three criteria over the language the Block Orthogonality condition, the Type Partition condition and 
the Mal'tsev condition. We show that #CSP(J-') is ^P-hard if J- violates any of these three conditions, 
and give a polynomial-time algorithm for #CSP(J-') when all three conditions are satisfied. 

One open question is then to determine the decidability of our dichotomy criteria. Note that all the 
dichotomies discussed in the introduction are known to be decidable in NP, with many of them decidable 
in polynomial time. From the definitions of our dichotomy criteria, each of them requires one to check a 
condition on an infinitary object. Given a language J- as the input, can we decide whether satisfies all 
three conditions in finite time? If so, can we further show that the decision problem is in NP? 
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